🌐 Website Social Links Scraper – High-Speed Profile Extractor

This Apify actor extracts social media profiles and community links directly from websites with high accuracy and intelligent validation.

It combines Cheerio-based HTML scraping, advanced regex matching, smart brand-name filtering, internal link discovery, and domain-level aggregation to identify, validate, deduplicate, and organize social profiles while filtering out share links, tracking URLs, irrelevant external pages, and false positives.

---

🚀 What It Does

For every website URL provided, the actor extracts:

🏢 Website Overview

• 🌐 Input URL
• 🔗 Target Domain
• 🏷️ Brand Name
• 📊 Pages Scanned
• 🧮 Total Profiles Found

---

📱 Social Profile Data

For each social platform found:

• 🐦 Twitter / X
• 💼 LinkedIn
• 📸 Instagram
• 📘 Facebook
• 🎥 YouTube
• 🎵 TikTok
• 🐙 GitHub
• 👾 Discord
• 👽 Reddit
• 📌 Pinterest

---

⚡ It Handles

• ✅ Multiple website URLs and raw domains
• 🔄 Automatic URL normalization
• ⚡ High-speed raw HTML scraping
• 🛡️ Anti-blocking capabilities
• 🧠 Smart Brand-Name Filtering
• 🚫 Share-link and intent-link filtering
• 🧹 Domain-level deduplication
• 🔗 Same-hostname internal crawling
• 📊 Cross-page profile aggregation
• 🎯 Platform-specific validation

---

🧠 How It Works

1. Loads website URLs and normalizes domains

2. Extracts the base domain and brand name

3. Fetches raw HTML using CheerioCrawler with optimized request handling

4. Scans:

   • HTML content
   • Anchor tags
   • Embedded JSON data
   • Next.js hydration data
   • Structured metadata

5. Uses advanced regular expressions to identify social profile URLs

6. Filters:

   • Share links
   • Intent endpoints
   • Tracking parameters
   • Non-profile URLs

7. Applies Smart Brand-Name Validation to ensure profiles belong to the target website

8. Discovers and crawls internal pages such as:

   • Contact pages
   • About pages
   • Team pages
   • Community pages

9. Aggregates and deduplicates profiles across all crawled pages

10. Saves structured results to the Apify Dataset

---

⚙️ Input Configuration

Field	Type	Description	Default
startUrls	Array	List of website URLs or domains to scrape	[]
platforms	Array	Social platforms to extract	["facebook","twitter","linkedin"]
maxPagesPerDomain	Integer	Maximum pages to crawl per domain	10
proxyConfiguration	Object	Proxy settings for anti-blocking	{"useApifyProxy":true}

---

🧩 Example Input

{
  "startUrls": [
    "apify.com"
  ],
  "platforms": [
    "twitter",
    "linkedin",
    "youtube",
    "tiktok",
    "github",
    "discord"
  ],
  "maxPagesPerDomain": 5
}

---

📊 Example Output

{
  "inputUrl": "https://apify.com",
  "targetDomain": "apify.com",
  "brandName": "apify",
  "statistics": {
    "pagesScanned": 5,
    "totalProfilesFound": 8
  },
  "socialProfiles": {
    "twitter": [
      "https://x.com/apify"
    ],
    "linkedin": [
      "https://linkedin.com/company/apify"
    ],
    "youtube": [
      "https://www.youtube.com/apify"
    ],
    "tiktok": [
      "https://www.tiktok.com/@apifytech"
    ],
    "github": [
      "https://github.com/apify"
    ],
    "discord": [
      "https://discord.com/invite/jyEM2PRvMU",
      "https://discord.gg/w3e2v7rWDw"
    ]
  }
}

---

If no social profiles are found:

{
  "inputUrl": "https://example.com",
  "targetDomain": "example.com",
  "brandName": "example",
  "statistics": {
    "pagesScanned": 2,
    "totalProfilesFound": 0
  },
  "socialProfiles": {}
}

---

❌ Error Handling

If a website cannot be accessed or processed:

{
  "inputUrl": "https://example.com",
  "targetDomain": "example.com",
  "status": "Failed",
  "error": "Request failed completely (check proxy or rate limits)",
  "statistics": {
    "pagesScanned": 0,
    "totalProfilesFound": 0
  },
  "socialProfiles": {}
}

---

🧠 Features

• 🌐 Accurate social profile extraction
• ⚡ High-speed HTML-based scraping
• 🛡️ Built-in anti-blocking mechanisms
• 🧠 Smart brand-name validation
• 🔗 Automatic internal page discovery
• 🧹 Cross-page deduplication
• 📊 Domain-level aggregation
• 🎯 Platform-specific filtering
• 🚫 Share-link elimination
• 🏷️ Structured social profile organization

---

💡 Use Cases

• B2B Lead Generation
• CRM Data Enrichment
• Influencer Discovery
• Brand Intelligence Research
• Competitor Analysis
• Sales Prospecting
• Community Discovery
• Cold Outreach Campaigns

---

❓ FAQs

1. Why is it so fast?

The actor downloads and processes raw HTML directly instead of launching a full browser session. Combined with CheerioCrawler and optimized parsing, it delivers significantly higher throughput while minimizing resource consumption.

---

2. Will it work on JavaScript-heavy websites?

In many cases, yes. Modern frameworks such as Next.js and Nuxt often embed their application state directly into HTML. Since the scraper scans the entire HTML response, including embedded JSON data, it can frequently extract social profiles without rendering JavaScript.

---

3. How does Smart Brand-Name Filtering work?

The actor extracts the website's brand name from its domain and validates discovered social profile handles against that brand. This prevents unrelated user profiles from being incorrectly associated with the target website.

---

4. Why are Discord links treated differently?

Discord invite URLs typically contain randomized invite codes rather than brand names. To avoid missing legitimate community links, Discord URLs are exempt from strict brand-name validation.

---

🧑‍💻 Developer Info

Author: codescraper

Email: codescraper011@gmail.com

---

🏷️ Tags

social-scraper · social-links-extractor · lead-generation · data-enrichment · osint · b2b-data · contact-extractor · web-scraping